Occupation times of random walks in confined geometries: Prom random trap model 

to diffusion limited reactions. 
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We consider a random walk in confined geometry, starting from a site and eventually reaching a 
target site. We calculate analytically the distribution of the occupation time on a third site, before 
reaching the target site. The obtained distribution is exact, and completely explicit in the case or 
parallepipedic confining domains. We discuss implications of these results in two different fields: 
The mean first passage time for the random trap model is computed in dimensions greater than 
1, and is shown to display a non-trivial dependence with the source and target positions ; The 
probability of reaction with a given imperfect center before being trapped by another one is also 
explicitly calculated, revealing a complex dependence both in geometrical and chemical parameters. 
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How many times, up to an observation time t, a given 
site i of a lattice has been visited by a random walker? 
The study of the statistics of this general quantity, known 
in the random walk literature as the occupation time of 
this site has been a subject of interest for long, both 
for mathematicians 0, [J and physicists @, S, |, i, 0, 
H, H, As a matter of fact, the occupation time has 
proven to be a ke y q uantity in various fields, ranging 
from astrophysics [Tl(, transport in porous media [12( 
and diffusion limited reactions [l3j]. The point is that as 
soon as the sites of a system have different physical or 
chemical properties, it becomes crucial to know precisely 
how many times each site is visited by the random walker. 

An especially important situation concerns the case 
when the observation time t up to which the occupation 
of site i is considered is itself random and generated by 
the random walker. To settle things and show how that 
occupation time Ni comes into play in various physical 
situations, we first give two different examples. 

The first one concerns the case of the so-called random 
trap model (problem I), which is a very famous model 
of transport in quenched disordered media [llj]. In this 
random trap model, a walker performs a symmetric lat- 
tice random walk, jumping towards neighboring sites. In 
addition, the time the walkers spends at each site is a 
random variable r^, drawn once and for all from a prob- 
ability distribution ip, which is identical for all sites. A 
quantity which has proven to be especially important in 
transport properties is the first passage time, the time 
it takes to reach a given target site. It is the key prop- 
erty in many physical applications I14l llal , ranging from 
diffusion- limited reactions [III Il7l. fl8l Il9| to search pro- 
cesses (e.g. animals searching for food) [2fJ. The mean 
first passage time (MFPT) for the random trap model has 
been studied [2l], [53] but, to our knowledge, these deter- 
minations have been strictly limited to the very specific 
ID case, and higher dimensional computations in confin- 
ing geometries like in FigQ] are still lacking (see never- 
theless [23[ for a d dimensional related problem). The 
relation with the occupation time is the following: The 
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FIG. 1: Color online. Schematic picture of the problem: the 
random walk begins at the site S, and the occupation time 
Ni is the number of times it visits the site i before reaching 
the target T. In this picture, Ni = 2. 



MFPT at the target starting from site r$ can be writ- 
v 

ten down as (T) = V^(Ni)rj, where V is the volume of 

i=l 

the confining system, Ni is the number of times the site 
i has been visited before the target is reached and (...) 
stands for the average with respect to the random walk. 
Concerning the distribution of the MFPT with respect 
to the disorder, that is with respect to the r^'s, we are 
finally back to summing a deterministic number V of in- 
dependent random variables (Ni)rj but non identically 
distributed (because of the factor (Ni)), which requires 
the determination of the mean occupation times (Ni) we 
introduced before. 

The second situation has to deal with a very differ- 
ent problem (problem II), which is involved for diffusion 
limited reactions in confined media. We consider a free 
diffusing reactant A that enters in a cavity, and which 
can react with a given fixed center i. We assume that 
each time the walker reaches the reactive site i, it has 
a probability p to react, which schematically mimics an 
imperfect reaction in confined geometry. Actually, nu- 
merous chemical reactions, ranging from trapping in su- 
permolecules |24l| to activation processes of synaptic re- 
ceptors HU, [2f| can be roughly rephrased by this generic 
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scheme. The question we address here, which does not 
seem to have been considered before, is the following: 
what is the probability for A to react with the center i 
before exiting the cavity? More generally, for a random 
walker starting from a site S 1 , what is the probability Q 
to react with i before reaching a target site T, possibly 
different from S. Partitioning over the number of times 
the reactive site i has been visited, we have: 



Q = l-J2P(N i = k)(l-p) h 



(1) 



k=0 



Once again, the random variable Nj is involved, but that 
time the determination of the entire distribution P(Nj = 
k) is needed. 

In this Letter, we propose for the first time a method of 
computation of the statistics of Nj in confining geometry. 
In particular, we obtain explicitly the exact distribution 
in the case of parallepipedic confining domains. Applica- 
tions to the above mentioned examples are discussed. 

We start with the computation of the mean (Ni), as- 
suming for the time being that the starting and target 
sites are different (S ^ T). We note w%j the transition 
probabilities from site j to site i. We have w, 



and we take w. 
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= 1, 

These general transition proba- 



bilities can take into account reflecting boundary condi- 
tions. We consider an outgoing flux J of particles in S. 
Since the domain is finite, all the particles are eventually 
absorbed in T, and, in the stationary regime, there is 
an incoming flux J of particles in T . The mean particle 
density pi thus satisfies the following equation: 
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with the boundary condition px — (it is the absorbing 
site). To find the mean occupation time, we can simply 
notice that the mean particle density pi is equal to (Ni) J. 
To solve this problem, we use the pseudo-Green function 
H [US, which satisfies: 
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where V is the total number of sites of the lattice. 
It is also symmetrical in its arguments, and the sum 
^^H(ri\rj) is a constant independent of j. Using the 

i 

concise notation Hij — H(ri\rj), it can be seen by direct 
substitution that pi given by 
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(4) 



satisfies Eq.([2]) as well as the boundary condition px = 0. 
Note that these results also give the mean occupation 
time of a subdomain, which is simply the sum of the 
mean occupation time of all the sites in the subdomain. 
In particular, we can check that the mean occupation 



time for the whole domain, V(Ni) = V(Htt — Hst), 
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gives back the MFPT from S to T |28|,|29fl. 

Before we go further, it is necessary to give a few ele- 
ments on the evaluation of H for isotropic random walks. 
The following exact expression [28l . [30( is known in two 
dimensions for rectangles: 
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where X and Y arc the dimensions of the rectangle, and 
the coordinates x and y are half- integers going from 1/2 
to X — 1/2 or Y — 1/2. There is also a similar expression 
for parallepipedic domains in three dimensions. In more 
general domains, the most basic approximation (which 
usually gives a good order of magnitude) is to approxi- 
mate H by the infinite-space lattice Green function Go 
[H, G being evaluated as G (r|r') = 3/(27r|r - r'|) 
for r r', and Go(r|r) = 1.516... in three dimen- 
sions, and Go(r|r') = — (2/7r)ln|r — r'| for r ^ r', and 
Go(r|r) = 1.029... in two dimensions. More accurate ap- 
proximations can be found [28| . but the above approxi- 
mations are good enough to capture the qualitative be- 
havior of the pseudo-Green function, and of the distribu- 
tion of the occupation time. 

It is indeed possible to obtain not only the mean, but 
also the entire distribution of the occupation time. The 
idea to tackle this a priori difficult problem is to use re- 
cent results concerning the so-called splitting probabili- 
ties [lj, [23, [29| . In presence of two targets T\ and To, the 
splitting probability P\ to reach T\ before T2 is [H, [29[ : 
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Denoting here Pij(i\S) the splitting probability to reach 
i before j, starting from S, we have P(Ni = 0) = 
P iT {T\S), and for k > 1: 



P(N, = k) = P tT {i\S) 
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The three terms of this last equation correspond respec- 
tively to the probability to reach i before T, starting from 
S, the probability to return to i before reaching T, start- 
ing from i, to the power k — 1, and the probability to 
reach T before returning to i. It can thus be written 



with 



P(Ni = k) = AB{1 - Bf- 1 for k > I, (8) 



a r> c\ as His + H T t - H ST - H lT 

A = P ^W= H ti + H TT -2H^ ' (9) 
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H u + H, 



TT 



2H; 



iT 



Hu + H TT — 2H iT ' 



(11) 
(12) 



using Eq.Q, and J2i w ij = 1- It can also be noted that 
P(Ni = 0) = 1 — A. The distribution of the occupa- 
tion numbers given by Eqs.([8|)- (fT2|) is the main result of 
this Letter, and several comments are in order, (i) Ex- 
pressions of H given in Eq.([5]) makes this result exact 
and completely explicit for parallepipedic domains, (ii) 
Computing (Ni) with this distribution gives back the 
expected result (iii) It can be noted here that B, 

which characterizes the decay of the probability distri- 
bution of Ni, is independent of the source. In addition, 
qualitatively, the basic evaluations of H following Eq. (J5j) 
(namely H = Go) give for B the following order of mag- 
nitude, if i and T are at a distance R: 
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where Go(0) = Go(r|r) is a dimension-dependant con- 
stant, given in the discussion on the evaluation of H. 
This shows that B decreases with the distance between 
i and T: a larger distance corresponds to a slower decay. 
But, while it tends towards in two dimensions (which 
corresponds to a wide distribution of Nj, and a large 
variance), it tends to a finite value in three dimensions. 
It can thus be said that the sites much further from the 
target than the source have, in three dimensions, a sig- 
nificant probability to be visited, but a low probability 
to be visited many times, whereas, in two dimensions, 
they have a low probability to be visited at all, but a 
comparatively high probability to be visited many times. 
This is connected with the transient or recurrent charac- 
ter of the free random walk in two or three dimensions, 
(iv) The results obtained here for different starting and 
target sites may easily be adapted to identical starting 
and target sites (S = T): 

P(N; = 0) = l-B ; P(Nj = k) = B 2 (l-B) k - 1 for k > 1. 

Note that this gives in particular a mean occupation time 
of 1 for all sites, a result which could be derived from an 
extension of Kac's formula [lLl2a|. However, here, we ob- 
tain not only the mean occupation number but the entire 
distribution of this occupation number, which appears to 
vary from site to site: the further the site is from the tar- 
get, the slower the probability distribution decays. 

We now discuss the applications of these general re- 
sults to the examples mentioned in the introduction. As 
for the random trap model (problem I), we focus here 
on the especially interesting case of a one-sided Levy 



stable distribution il)(t) = / Q (i,T acos(7ra/2),l,0)) 
(0 < a < 1), which corresponds to an algebraic decay: 
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and whose Laplace transform is ip( u ) = exp(— t^u") (to 
can be seen as the typical waiting time). The Laplace 
transform tt(u) of the distribution of the MFPT with 
respect to the disorder reads 

v 

tt(u) - n^ Ni > u ) = cxp(~(T typ u) a ) (16) 

The probability density of the MFPT is then as could 
have been expected a one-sided Levy stable law, but with 
a non trivial typical time: 

/ v \ l / a 

T typ = T \y2(His - H lT + H TT - H ST ) a \ (17) 

For large size domain V, this result can be applied to 
any wide-tailed distribution of the waiting times satisfy- 
ing Eq. (fl"5"|) [l2j. It can be shown that T typ is bounded 
by toV 1 ^ c "(Htt — Hst), and tends towards this upper 
bound as V grows, which provides a simple estimation 
of T typ and indicates that for large enough domains, the 
scaling of T typ with the source and target positions is 
the same as for the discrete-time random walk (pure sys- 
tems) [28|, We thus showed that the random trap 
problem in confined geometries, with a wide-tailed wait- 
ing time distribution, has a Levy distribution of mean 
first-passage times, with a non-trivial typical time. The 
scaling with the size V is V 1 ^. The scaling with the 
source and target positions is modified by the disorder in 
small confining domains, while it is the same as for pure 
systems in large enough domains. 

Concerning the application to diffusion-limited reac- 
tions (problem II) , the probability Q to have reacted with 
i before reaching T writes, using Eqs. (HJ) , ((HJ) : 
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The expression (TTgl) displays a subtle interplay between 
the geometrical factors, involved through the terms A 
and B, and the reactivity p. Focusing now on the spe- 
cific case of identical starting and target points (meaning 
A = B, cf. Eq. (fT4|) ). we exhibit two interesting lim- 
iting regimes. In the "reactivity limited regime" , de- 
fined by p <C £>, we have Q ~ p. In particular, in 
that regime Q does not depend on the reactive site i. 
In other words, for a fixed reactivity p, all sites i such 
that p B have the same probability of reaction Q, and 
the detailed position of i does not come into play. On the 
contrary, the "geometrically limited regime" p> B leads 
to Q ~ B, which does no longer depend on p, but only 
on the geometry. Given the order of magnitude of B (cf. 
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FIG. 2: Color online. Simulations (symbols) versus analytical 
prediction (lines) Eq. (|18[) of the probability Q to react before 
returning to the target site as a function of the probability 
to react at site i. The confining domain is a square of side 
51, and the target is at the middle of an edge, of coordinates 
(0,25), the site (0,0) being a corner site. The three curves 
corresponds to different positions of site i: (1,25) (red upper 
curve), (25,25) (blue mid curve), and (50,25) (green lower 
curve) . 

Eq. (fT5|) ). this can essentially happen in two dimensions, 
when R ^> exp(— ir/(2p)). This can be explained by the 
recurrent character of the two-dimensional random walk: 
when the reacting site i is far enough from the target, if a 
random walker reaches it, it is likely to visit it many times 
before returning to T, and is thus almost sure to react 
whenever i is reached. The reaction probability Q then 
becomes the probability to reach the site i. Consequently, 
the position of the reacting site has a low influence on re- 
activity in three dimensions, or when the reacting site is 
within a disk of radius R = exp(— n/2p) around the tar- 
get in two dimensions. If the reacting site is further, the 



geometrical effects become preeminent. We show in Fig. 
[5] a graph of Q, as a function of p, for different positions 
of i (near the target, in the middle of the domain, and at 
the opposite) , the source and target point being identical. 
The limiting regimes can be well identified. 

To conclude, we have computed the distribution of the 
occupation time of a given site i, for a random walk in 
confined geometry, eventually trapped at a target. This 
distribution is exact, and completely explicit in the case 
or parallepipedic confining domains. While the mean oc- 
cupation time, unsurprisingly, is higher when i is near 
the source and lower near the target (and uniform if 
the source and target are identical), the distribution of 
the occupation time is essentially exponential, with a 
slower decay when the point is far away from the tar- 
get. We have also presented important applications of 
these results in two different fields. The first one is trans- 
port in quenched disorder media: The mean first pas- 
sage time for the random trap model has been computed 
for the first time in dimensions greater than 1, and has 
been shown to display a non-trivial dependence with the 
source and target positions. The second application is 
to diffusion limited reactions in confined geometry: The 
probability of reaction with a given imperfect center be- 
fore being trapped by another one has been explicitly 
calculated, and has proven to present a complex depen- 
dence both in the geometrical and chemical parameters. 
We believe that the results obtained in this Letter could 
be relevant to systems involving diffusion in confining 
domains, displaying inhomogeneous physical or chemical 
properties. . 
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